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INTRODUCTORY COMMENTS 

This communication is responsive to the Examiner initiated 
telephonic interview conducted on October 31, 2007. 

An "Amendments to the Claims" section begins on page 3 of this 
paper. An "Arguments/Remarks" section begins on page 18 of this paper. 
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AMENDMENTS TO THE CLAIMS 

Claims 1-40 were originally pending. Please amend claims 11, 16, 
18-27, 33 and 37. Kindly cancel claims 15, 17, 32, 34-36 and 38 without 
prejudice. No claims are added or withdrawn. Accordingly, claims 1-14, 
16, 18-31, 33, 37, and 39-40 remain pending. 

The following listing of claims replaces all prior versions and 
listings of claims in the application. 

1. (Previously presented) A process implemented by a 
computing device for comparing two digital images, the process 
comprising: 

comparing texture moment data for the two images to provide a first 
similarity index; 

comparing color correlogram data for the two images to provide a 
second similarity index; 

comparing color moment data for the two images to provide a third 
similarity index; 

combining the first, second and third similarity indices to provide a 
similarity value; 

determining that the two images match when the similarity value 
exceeds a first threshold value; and 

responsive to determining that the two images match, providing an 
indication that the two images match. 
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2. (Original) The process of claim 1, wherein combining 
comprises forming a weighted sum from the first, second and third 
similarity indices. 

3. (Original) The process of claim 1, further comprising 
determining that the two images do not match when the similarity value is 
less than a second threshold value. 

4. (Original) The process of claim 1, wherein the two images 
comprise a first and a second image, the first of the two images comprises a 
query image, and further comprising locating one or more matches to a 
plurality of images in a database of images by iterating the acts of 
comparing color correlogram data, comparing color moment data, 
comparing texture moment data, combining and determining using as the 
second image a successive one image of the plurality of images. 

5. (Original) The process of claim 1, further comprising: 
comparing one or more high-level features from each of the two 

images; and 

adjusting the similarity value in accordance with comparing one or 
more high-level features, prior to determining. 

6. (Original) The process of claim 1, further comprising: 
extracting one or more high-level features from each of the two 

images, wherein the one or more high-level features include a high-level 
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feature chosen from a group consisting of: presence/absence of one or more 
human faces, indoor/outdoor scene and time/date of image formation; 

comparing one or more of the high-level features from each of the 
two images; and 

adjusting the similarity value in accordance with comparing one or 
more high-level features, prior to determining. 

7. (Original) The process of claim 1, further comprising, after 
combining and before determining, adjusting the similarity value based on 
a calculation of commonality or lack of commonality between one or more 
high-level features associated with each of the two images and a confidence 
value thereof. 

8. (Original) The process of claim 1, wherein at least one of the 
two images is a digital image taken using a digital camera. 

9. (Original) The process of claim 1, wherein combining 
comprises: 

weighting the first, second and third similarity indices by assigning 
the first similarity index a greatest weight and assigning the third similarity 
index a least weight; and 

adding the weighted first, second and third similarity indices to 
provide an adjusted similarity value, wherein determining employs the 
adjusted similarity value in determining that the two images match. 
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10. (Original) The process of claim 1, further comprising 
quantizing the similarity value prior to determining, wherein quantizing 
comprises quantizing according to a tiered ranking scheme employing 
fewer than ten levels ranging from a lowest to a highest tier, with greater 
similarity values corresponding to higher tiers, wherein the first threshold 
value corresponds to a highest tier into which similarity values are 
quantized. 

11. (Currently amended) A process implemented by a computing 
device for manipulating image characterization data from a digital image, 
the process comprising: 

indexing the digital image by extracting low-level feature data 
corresponding to a plurality of low-level features from the digital image, 
the plurality comprising two or more low-level features chosen from a 
group consi s ting of: comprising texture moment data^ color correlogram 
data^ and color moment data; 

organizing the data into a feature vector by; 

(a) forming a query vector; 

(b) if extracted low-level feature data corresponds to: 

(0 texture moment data: comparing texture moment 
data for the query and feature vectors to provide a first similarity index; 

(ii) color correlogram data: comparing color 
correlogram data for the query and feature vectors to provide a second 
similarity index; and 
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(in) color moment data: comparing color moment data 
for the query and feature vectors to provide a third similarity index; and 

(c) combining available ones of the first, second and third 
similarity indices to provide the feature vector; 

utilizing the feature vector to identify a set of similar digital images; 

and 

providing a result that identifies the set of similar images. 

12. (Original) The process of claim 11 ? wherein indexing 
comprises: 

first extracting texture moment data from the digital image; 

second extracting color correlogram data from the digital image; and 

third extracting color moment data from the digital image. 

13. (Original) The process of claim 1 1, further comprising storing 
the feature vector in a database. 

14. (Original) The process of claim 11, wherein organizing the 
data comprises forming a query vector, and further comprising: 

obtaining a feature vector from a group of feature, vectors 
corresponding to a plurality of digital images; 

comparing the query vector to the feature vector to provide a 
similarity value; 

determining when the similarity value exceeds a first threshold; and 
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iterating obtaining, comparing and determining for each feature 
vector of the group. 

15. (Canceled) 

16. (Currently amended) A process computer-readable storage 
medium having embedded there on computer-program instructions for 
comparing two digital images, the computer-program instructions, when 
executed by a processor, for performing operations comprising: 

comparing texture moment data for the two images to provide a 
similarity index , the similarity index being a first similarity index ; 

comparing color correlogram data for the two images to provide a 
second similarity index; 

comparing color moment data for the two images to provide a third 
similarity index; 

combining the first similarity index with other data to provide a 
similarity value , the other data comprising the second and the third 
similarity indices : 

determining a degree to which the two images match when the 
similarity value exceeds a first threshold value; and 

responsive to determining the degree to which the two images 
match, providing a result that indicates whether the two images match. 

17. (Canceled) 
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18. (Currently amended) The process computer-readable storage 
medium of claim 16, wherein combining comprises forming a weighted 
sum from the similarity index and other data. 

19. (Currently amended) The proces s computer-readable storage 
medium of claim 16, further comprising determining that the two images do 
not match when the similarity value is less than a second threshold value. 

20. (Currently amended) The proces s computer-readable storage 
medium of claim 16, wherein the two images comprise a first and a second 
image, the first of the two images comprises a query image, and further 
comprising locating one or more matches to a plurality of images in a 
database of images by iterating the acts of comparing, combining and 
determining using as the second image a successive one image taken from 
the plurality of images. 

21. (Currently amended) The process computer-readable storage 
medium of claim 16, further comprising: 

comparing one or more high-level features from each of the two 
images; and 

adjusting the similarity value in accordance with comparing one or 
more high-level features, prior to determining. 



22. (Currently amended) The process computer-readable storage 
medium of claim 16, further comprising: 
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extracting one or more high-level features from each of the two 
images, wherein the one or more high-level features include a high-level 
feature chosen from a group consisting of: presence/absence of one or more 
human faces, indoor/outdoor scene and time/date of image formation; 

comparing one or more high-level features from each of the two 
images; and 

adjusting the similarity value in accordance with comparing one or 
more high-level features, prior to determining. 

23. (Currently amended) The proc es s computer-readable storage 
medium of claim 16, further comprising, after combining and before 
determining, adjusting the similarity value based on a calculation of 
commonality or lack of commonality between one or more high-level 
features associated with each of the two images and a confidence value 
thereof. 

24. (Currently amended) The process computer-readable storage 
medium of claim 16, wherein at least one of the two images is a digital 
image taken using a digital camera. 

25. (Currently amended) The proc ess computer-readable storage 
medium of claim 16, wherein the similarity index is a first similarity index, 
and further comprising wherein combining the first similarity index with 
the other data further comprises : 
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comparing color correlogram data for the two image s to provide a 
second similarity index; and 

comparing color moment data for the two images to provide a third 
s imilarity index; 

wherein combining comprise s : 

weighting the first, second and third similarity indices by assigning 
the first similarity index a greatest weight and assigning the third similarity 
index a least weight; and 

adding the weighted first, second and third similarity indices to 
provide an adjusted similarity value, wherein determining employs the 
adjusted similarity value in determining that the two images match when 
the similarity value exceeds the first threshold value. 

26. (Currently amended) The proc ess computer-readable storage 
medium of claim 16, further comprising quantizing the similarity value 
according to a tiered ranking scheme employing fewer than ten levels 
ranging from a lowest to a highest tier, with greater similarity values 
corresponding to higher tiers, wherein the first threshold value corresponds 
to a highest tier into which similarity values are quantized. 

27. (Currently amended) A camera comprising: 

an image capture device configured to capture digital images; 
a memory coupled to the image capture device and configured to 
store a database of image data, including the digital images and associated 
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feature vectors each comprising texture moment data, correlogram data and 
color moment data; and 

an image similarity module coupled to the memory and configured 

to: 

generate a query vector comprising texture moment data a 
correlogram data and color moment data ; 

compare, in succession, the query vector to each feature 
vector in the database, to generate a similarity value; 

classify each feature vector to assign each feature vector to a 
tier in a tiered similarity structure based on the associated similarity 
value; 

group images associated with the respective feature vectors in 
each tier of the similarity structure to generate group(s) of similar 
images; and 

provide the group(s) of similar images for sorting. 

28. (Original) The camera of claim 27, wherein the image 
similarity module is further configured to: 

adjust each similarity value in conformance with comparison of 
high-level data corresponding to the query vector and high-level data 
corresponding to each feature vector to provide an adjusted similarity value 
corresponding to each feature vector; and 

use the adjusted similarity value to classify each feature vector in the 
tiered similarity structure. 
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29. (Original) The camera of claim 27, wherein the image 
similarity module is further configured to adjust each similarity value in 
conformance with comparison of high-level data corresponding to the 
query vector and high-level data corresponding to each feature vector to 
provide an adjusted similarity value corresponding to each feature vector, 
wherein high-level data comprises: presence/absence of one or more human 
faces; indoor/outdoor scene; and time of image formation. 

30. (Original) The camera of claim 27, wherein the image 
similarity module is further configured to: 

adjust each similarity value in conformance with comparison of 
high-level data corresponding to the query vector and high-level data 
corresponding to each feature vector to provide an adjusted similarity value 
corresponding to each feature vector, wherein high-level data comprises: 
presence/absence of one or more human faces, indoor/outdoor scene and 
time/date of image formation; and 

use the adjusted similarity value to classify each feature vector in 
the tiered similarity structure. 

31. (Original) The camera of claim 27, further comprising a 
monitor configured to facilitate viewing of digital images stored in the 
database, wherein the digital images are accessed via associated feature 
vectors selected within a tier of the tiered similarity structure. 



32. (Canceled) 
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33 . (Currently amended) A computer readable storage medium en 
a tangible data storage device, the computer r e adable medium having 
embedded thereon a plurality of computer-program instructions , the 
computer-program instructions, t hereon that, when executed by one or 
more processors, caus e th e one or mor e processors to for performing 
operations comprising : 

successively compar e comparing a query vector to each feature 
vector in a database, the query vector and the feature vectors each including 
texture moment dat a, correlogram data and color moment data : 

successively compare texture moment data from the query vector to 
texture moment data from each feature vector to provide a first similarity 
index; 

successively compare correlogram data from the query vector to 
correlogram data from each feature vector to provide a second similarity 
index; 

successively compare color moment data from the query vector to 
color moment data from each feature vector to provide a third similarity 
index; and 

form a similarity value as a weighted sum of the first, second and 
third similarity indices for each feature vector, wherein the plurality of 
instructions that cause the one or more processors to rank comprise 
instructions that cause the one or more processors to quantize similarity 
values into ranked tiers based in part on high-level features associated with 
the query vector and the feature vectors, each tier corresponding to a 
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different degree of similarity between the query vector and the feature 
vectors associated with that tier; 

rank ranking each feature vector into a tier of a tiered classification 
scheme based on the comparison between the feature vector and the query 
vector; and 

utilizing the tiered classification scheme to provide an indication 
whether first and second digital images have matching similarities. 

34. (Canceled) 

35. (Canceled) 

36. (Canceled) 

37. (Currently amended) A system for image correlation 
comprising: 

one or more processors; 

a memory coupled to the one or more processors , the memory 
comprising computer-program instructions executable by the one or more 
processors and configured to store a database representing digital images,, 
the computer-program instructions comprising ; 

an image comparison module configured to 

(a) cause the one or more processors to access the data 
representing the images and to select one or more feature vectors each 
associated with a corresponding image based on comparison of color 

LEE & HAYES, pllc 1 5 MSI- 1621 US. M02 



Application No. 1 0/689,1 06 

texture data and other data contained in each feature vector with analogous 
data contained in a query feature vector; and 

(b) compare correlogram data and color moment data 
contained in each feature vector with analogous data contained in the query 
feature vector; and 

(c) select the one or more feature vectors based on a weighted 
sum of similarity indices respectively derived from comparing the color 
texture moments, the correlogram data and the color moment data; and 

a display device coupled to the one or more processors and to the 
memory and configured to display digital images corresponding to the 
selected one or more feature vectors in response to user input, the digital 
images having been determined to share a set of similarity characteristics. 

38. (Canceled) 

39. (Original) The system of claim 37, wherein the other data 
include high-level feature data. 

40. (Original) The system of claim 37, wherein the image 
comparison module further is configured to cause the one or more 
processors to: 

extract one or more high-level features contained in each feature 
vector and analogous data contained in the query feature vector, wherein 
the one or more high-level features include a high-level feature chosen from 
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a group consisting of: presence/absence of one or more human faces; 
indoor/outdoor scene; and time of image formation; 

compare one or more of the high-level features from each feature 
vector and analogous data contained in the query feature vector; and 

employ results from comparing the one or more high-level features 
in selecting the one or more feature vectors. 

41. (Canceled) 
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REMARKS 

Applicant thanks the Examiner for indicating that claims 1-10 were 
allowed, and that claims 15, 17, 32, 35 and 38 would be allowable if they 
incorporated the features of their respective base claim and any intervening 
claims. Applicant has so amended this application to place its application to 
condition for allowance. Specifically, claims 1-40 were originally pending. 
Claims 11, 16, 18-27, 33 and 37 were amended. Claims 15, 17, 32, 34-36 
and 38 were canceled without prejudice. No claims were added or 
withdrawn. Accordingly, claims 1-14, 16, 18-31, 33, 37, and 39-40 remain 
pending. These claim amendments have placed this application into 
condition for allowance. 

Withdrawal of the outstanding rejections to the pending claims is 
respectfully requested. 

Should any issue remain that prevents allowance of the application, 
the Examiner is encouraged to contact the undersigned to discuss this case 
prior to issuing any subsequent Action. 

Respectfully Submitted, 

Date: November PL 2007 By: /Brian G. Hart Reg. No. 44,421 / 

Brian G. Hart 
Reg. No. 44, 421 
(509) 324-9256 
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